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Abstract. Garsia-Haiman modules C[X n ,Y n ]x 7 are quotient rings in vari- 
ables X n = {xi, X2, ■ ■ . , x n } and Y n = {y\, y2, ■ ■ ■ , Vn) that generalize the 
quotient ring C[X n ]/I, where X is the ideal generated by the elementary sym- 
metric polynomials ej(X n ) for 1 < j < n. A bitableau basis for the Garsia- 
Haiman modules of hollow type is constructed. Applications of this basis to 
representation theory and other related polynomial spaces are considered. 



1. Introduction 

Let X n — {x\, . . . , x n } and Y n = {y\, . . . , y n } be sets of indeterminates. The 
main purpose of this paper is to give explicit combinatorial bases for certain quo- 
tients of the ring 

(1) C[X n ,Y n ] = C[a;i,x 2 , . . .,x n ,y 1 ,y 2 , ■■■ ) y n ] 

of polynomials in the variables X n and Y n with complex coefficients. In doing so, 
we give combinatorial interpretations for the corresponding Hilbert and Frobenius 
series. The ideals in the aforementioned quotients are defined via determinants as 
described below. 

Throughout this paper, we will identify any element ai = 1,0^.2) £ N 2 with 
the unit square in the first quadrant of the plane having ai as its corner closest 
to the origin. A lattice diagram, L[a] — (ai, . . . ,a n ), is a sequence of such unit 
squares. Writing z"' for the product x" l l y" 1 ' 2 , to any lattice diagram L[a] we 
associate a determinant 



/ z 1 1 z 2 1 ■ ■ ■ z" 1 \ 



..a 2 
-2 



(2) A L[a] = A L[a] (X n ,Y n ) =det 

Given any polynomial P(X n , Y n ) 6 C[X n , Y n ], there is a corresponding polynomial 
of differential operators 

(3) P(d x ,d Y ) = P(d xl ,d X2 ,. . .,d Xn ,d yi ,d y2 ,. . .,d y J. 

(We write d Xi as shorthand for d/d Xi .) With a as above, define the ideal 

(4) I L[a] = {P(X n , Y n ) e C[X n ,Y n ] : P(d x , d Y )A L[a] = 0} 

and write C[X n ,Y n ]x L , a] for the quotient ring <C[X n ,Y n ]/T L ^. 

These quotients, known as Garsia-Haiman modules, were introduced by A. Gar- 
sia and M. Haiman in [9]. A good overview of the subject can be found in [12]. 
A. Garsia and M. Haiman introduced modules of this type to study the g, i-Kostka 
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coefficients. This paper will henceforth concern itself only with Garsia-Haiman 
modules arising from hollow lattice diagrams. Roughly, a hollow lattice diagram is 
a subset of a hook shape obtained by removing a (perhaps trivial) contiguous region 
of cells from each of the arm and leg of the hook (see Figure 1). More precisely we 
parametrize hollow lattice diagrams L 7 by sequences of three pairs 7 = (m,k,p), 
with m — (mi, 7712) S Z> l5 fc = (k\,k 2 ) S Z% 1 and p — (pi,P2) £ N 2 , by setting 
L~ f = L[a] where 

a = ((0, 7712 + k 2 +P2 - 1), (0,7712 + &2 + P2 ~ 2), . . . , (0, 7712 + fe), 

(0, m 2 + k 2 - 1), (0, ma - 1), ... , (0, 1), (0, 0), (1, 0), (2, 0), 
. . . , (mi - 1, 0), (mi + h - 1, 0), . . . , (mi + h + Pl - 1, 0)) . 

(We also allow ki = if Pi =0.) Unless otherwise noted, the number of cells in L 7 
(namely, mi + pi + ni2 + P2 + 1) will be denoted by n. 



P 2 



m, 



ki 



Pi 



Figure 1. Hollow lattice diagram L 1 with m = (4, 2), k = (3, 2), 
and p = (5, 2). 



Abusing notation slightly, we write 2" 7 for Tl and A 7 for A l 7 . Our goal is to 
consider the combinatorics of the hollow Garsia-Haiman space C[X n , Y n \x^ ■ As sug- 
gested by the previous terminology, the rings C[A„, Y n ]x^ carry 5„-representations: 
The symmetric group S n has a natural diagonal action on C[X n , Y ra ] given by 

(5) o-P(x!, ...,x n ,yi,...,y n ) = P{x aW ,. . . , x a ( n ) , y a{1 ) , ■ ■ ■ ,Va{n))- 

This action passes through to an action on each C[X n , Y n ]j^. 

Let R be any S^-module realized as a polynomial ring over X n and Y n (such 
as <C[X n , Y n ]j^) and let i? r , s denote the subspace of R containing elements of total 
degree r in X n and total degree s in Y n . We can decompose each R r ^ s as R r ^ s — 
fflr,sC r ,s<S' A where each S x is an irreducible S^-module (i.e., Specht module). Denote 
the Schur functions by s\. The (bi-graded) character, Frobenius series and Hilbert 
series are then, respectively, given by 

ch(R) = J2 (E C ^X A ) * r 3*, 

r,s \Ahn / 

( 6 ) Fch(R) = J2[J2 C r,s S >) ^ 

r,s \\hn / 

H(R) = ^dim(i? r , s ) t r q s . 

r,s 
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Here x A denotes the character of S x and A h n signifies that A is a partition of 
n. The Frobcnius series is the image of the graded character under the Frobenius 
map which sends % A to s\. Note that the Hilbert series can be recovered from the 
Frobenius series by formally replacing each s\ by the dimension of S x . 

By constructing an appropriate basis we will prove the following theorem. (The 
definition of a standard tableau will be given in Section 2; the cocharge statistics 
|X(rs(C 7 (T)))| and |F(rs(C 7 (T)))| are defined in Section 6.) 

Theorem 1. Let C[X n , Y n ]x^ denote a hollow Garsia-Haiman module parametrized 
by 7 = (m,p, k). The graded character ch(CLY„, i / ra ]i T ) ofC[X n , Y n ]x i is given by 

() [pi + fcll |>2 + fel V- A V- ,|X(rs(C 7 (T)))| |Y(rs(C 7 (T)))| 

1 * J 9 Ahn TG5YT(A) 

where SYT(X) denotes the collection of standard tableau of shape A. 

The modified Macdonald polynomials are a family of symmetric functions over 
the field of Laurent polynomials in two variables that specialize to many important 
classical symmetric functions. Parametrized by partitions, they are given plethys- 
tically by 

(8) H,(z- q, t) = J M [t^TT; q, H t nM = Yl R ^ f ) 

L ^ A 

An argument analogous to the one used to prove Theorem 2.1 in [6] can be used to 
deduce the following corollary from Theorem 1. 

Corollary 2. The graded Frobenius characteristic of the hollow Garsia-Haiman 
module C[X n ,Y n ]i^ is given by the polynomial 

(9) T ch(CLY„, Y n ]x, t ) =E x (t) E e (q) H (m2+p2+llmi+P1) (z;q,t) 

where A = (fcf +1 ) 7 6 = (fcf +1 ) andZ v (t) gives the Hilbert polynomial of the graded 
vector space of skew Schur functions as fi varies in v. 

To prove Theorem 1 , we will define a sequence of ideals 

(10) Q 7 (X n ,Y n ) C 7i 7 (X„,y„) C ^{Xn^Yn) C JC 7 (X n ,Y n ) C T 7 (X n ,Y n ). 

For each ideal £ = £{X ni Y n ) in (10), we will define appropriate generators for £, 
construct a base for the corresponding quotient space C[X„,Y"„],c- = C[X n ,Y n ]/£, 
and compute the corresponding Hilbert series. To complete the proof, we will 
use a correspondence between our basis elements for C[X n ,Y n }x^ and irreducible 
characters of S n - Sections 2, 3 and 4 will introduce the necessary background and 
notation on tableaux, cocharge tableaux and symmetric polynomials, respectively. 
The following four sections consider the situations corresponding to £ 7 , H 7 , both 
and /C 7 , and both and T 7 , respectively. 

We note here that Garsia-Haiman modules corresponding to specific classes of 
lattice diagrams have been studied elsewhere. Periodic Garsia-Haiman modules 
were considered by the first author [3] and (in one variable) by H. Morita and 
H.-F. Yamada [15], R. Stanley [17] and J. Stembridge [18]. Dense Garsia-Haiman 
modules were investigated by the first author in [4]. The Garsia-Haiman modules 
corresponding to the degenerate hollow lattice diagrams of one-row skew shapes or 
one-column skew shapes were studied by F. Bergeron, A. Garsia and G. Tesler in 
[6]. 
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Finally, it should be noted that a conjecture has been announced by M. Haiman, 
J. Haglund, N. Lochr, J. Remmcl, and A. Ulyanov (sec [11]) for a combinatorial 
formula for the character of the coinvariants of the symmetric group. 

Remark 3. There is a wide variety of indexing and notational conventions among 
papers in this field. Most obviously, when the primary lattice diagrams under 
consideration are partitions, the correspondence between N 2 and first quadrant 
lattice points usually has the first index giving the y-coordinate. Also note that we 
here write (m, k,p) for the parametrizing tuple [[l mi , fei, l Pl ] , [l m2 ,k 2 , 1 P2 ]] of [4]. 

2. Tableaux 

A partition /i = (/ii,/X2, . . . , jUj, . . .) is a (possibly infinite) sequence of weakly 
decreasing integers with j > 1 nonzero terms. We will not distinguish between 

partitions with the same collection of nonzero terms. Write \fi\ = /Ji + [i 2 H V fij 

for the sum of the parts. If \fi\ = n, then we say that /i is a partition of n and write 
(ihn. The length, j, is denoted If i appears m, times in fi for each i, then 

the tuple (l mi , 2™ 2 , . . .) is called the type of fi. fi* will denote the transpose of it. 

Let /ijAhn. We use "<i ox " on partitions to denote the lexicographic order. A 
(French-style) Ferrers diagram of shape [i is a collection of left-justified unit squares 
("cells") in the first quadrant with fii squares in the ith row from the bottom. The 
shape of a Ferrers diagram D, sh(D), is the partition obtained by listing the row 
lengths of D. The notation dg(/x) will be used to denote the canonical Ferrers 
diagram of shape /x. 

A H-filling f is a map / : dg(/i) — ► £ from the cells of a Ferrers diagram to some 
totally ordered alphabet £. We will consider fillings with three different alphabets: 

(1) A' = {(a, b) : a, b G N} ordered by (oi, 6i) <a' {c-2, b 2 ) whenever 

(a) a\ - b x < a 2 - b 2 ; or 

(b) a\ — b\ = a 2 — b 2 and a\ < a 2 . 

Geometrically, the order can be visualized as listing the points in the 
first quadrant by reading down lines y = x + c from left to right with 
successively smaller values of c. 

(2) A = {(a, b) E A' : a = or b = 0} with the order <jy induced by <a>- 
Note that the elements of A index cells that can appear in a hollow lattice 
diagram. For brevity in formulas, we sometimes write a for (a, 0) and b 
for (0,6). The notation is meant to evoke positive and negative numbers, 
respectively, as this interpretation of the elements of A is consistent with 
<A- 

(3) N ordered byO<I<2<3<---. 

The picture (or pair (/, dg(/x))) obtained by placing elements of E in the cells 
of a Ferrers diagram of shape /x according to / is a E- filled diagram. When E is 
clear (or unimportant), we simply refer to filled diagrams. For a filled diagram 
U = (/, dg(/z)), we use the shorthand g(U) for the new filled diagram (g o /, dg(fi)). 

A filled diagram is injective if the map / is an injective map. When E = Z>i C N, 
we refer to a E-filled diagram as a tableau. A filled diagram of shape fj, is said to 
be column strict if the entries increase weakly from left to right in each row and 
increase strictly in each column from bottom to top. We will denote the collection 
of column-strict tableaux for a given alphabet E by C5s (and use CS n ,n if we want 
to specify the number of boxes). An injective column-strict tableau with distinct 
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entries {1, . . . , n} for some n is often referred to as a standard tableau. Let SYT, 
SYT(X), and SYT n denote the collections of standard tableaux, standard tableaux 
of shape A, and standard tableaux with n cells, respectively. In the context of 
filled diagrams, T will be reserved for a standard tableau; V for a column-strict 
tableau. Finally, for any filled diagram U, we define U 1 to be the tableau obtained 
by reflecting U along the line y — x. Figure 2 illustrates an „4-filled diagram U of 
shape sh(U) = (3, 2) along with its transpose U*. Note that in this case, £/* G CS^- 



u = 



(0,2) 


(0,1) 




(0,2) 


(0,0) 


(3,0) 



u = 



(3,0) 




(0,0) 


(0,1) 


(0,2) 


(0,2) 



FIGURE 2. An A- filled diagram and its transpose. 



Let I denote an injective tableau of shape \i = (fii, . . . , nj), Ri (1 < i < j) 
denote the collection of integers in the i th row of I and Di (1 < i < /ii) denote the 
collection of integers in the i th column of /. Set 

(11) R(I) = S Rl x S R2 x • • • x S Rj 
and 

(12) £>(/) =S Dl xS D2 x---x S Dm , 

where and denote the symmetric group on the collections of elements Ri 
and Di, respectively. Define, in the group algebra C[5 n ], 

(13) P(I) = a and N W = J2 s s n ( CT ) a - 

aeR(I) <JeD(I) 

A bitableau is a pair (S, U) of filled diagrams of the same shape where S is re- 
filled and U is ^'-filled. A standard bitableau satisfies the additional stipulations 
that S is a standard tableau and U € CSa>- The set of all standard bitableaux 
(S, U) on n boxes will be denoted 6„ if we restrict to U G CS n ,A an d if we do 
not place this restriction. 

Given any E-fillcd diagram U = (/, dg(/i)), define the standardization std(£7) = 
(^/,dg(/i)) by setting £f to be the unique standard filling such that: For cells 
c,de dgOu), 

(1) /(c) <s /(d) implies C/(c) < £/(<*)■ 

(2) If /(c) = /(d) and either 

(a) c is north of d, or 

(b) c is in the same row as d but west, 
then £/(c)<£/(<Q. 

For £7 a S-filled diagram and T a standard tableau, we denote the entry in U in 
the cell corresponding to i in T by u^. Two special cases that arise frequently are 
when T = std(£7) and when (T, U) is a bitableau. In the former case, we abbreviate 
uj by u l . 
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Let S be an injectivc N-fillcd tableau. Again writing z^ for ar-*' 1 ^-*' 2 , for a 
bitablcau (5, U) we set the bideterminant [S, U]det to be 



2 



(14) [S, U] det = N(S) z. 



a£D(S) 

Similarly, the corresponding bipermanent [S, U] per is given by 

(15) [S, U] peI = P(S) Z x x Z 2 2 ■ ■ ■ Z n n — ^2 Z cr(l) Z cr(2) " ' Z a(n)- 

aER(S) 

The following theorem is a special case of [10, Theorem 8] (also cf. [4, 7]). We 
suggest the reader work out some examples from the case n = 3 by hand. 

Lemma 4. The collections 

(16) BP = {[T, V] pcr : (T, V) £ Q' n ) and 

(17) BV = {[T,V} det : (T,V) e Q'J 
are infinite bases for C[X n , Y n \. 

For a S-fillcd diagram U, the row sequence rs(U) is the sequence obtained by 
listing the entries of U in each row from left to right, starting with the bottom row. 
The column sequence cs(U) is found by listing the entries of U from bottom to 
top in each column, starting with the leftmost column. Finally, the content k(U) 
is a rearrangement of the row sequence rs(U) of U into nondecreasing order with 
respect to <£• 

Example 5. For U as in Figure 2, we have 

rs(U) = ((0, 2), (0, 0), (3, 0), (0, 2), (0, 1)) = (2,0, 3,2,1) , 
cs(U) = ((0, 2), (0, 2), (0, 0), (0, 1), (3, 0)) = (2,2,0,1, 3) , and 
k(U) - ((0, 2), (0, 2), (0, 1), (0,0), (3,0)) = (2,2,1,0,3) . 

There are two orderings of bitableaux that are particularly important when con- 
sidering elements of BT> or BV. Let >i cx (^') denote the lexicographic order with 
respect to >a* ■ Fot tableau, Si, U\, S2 and U2, we will say that 

(18) (Si.tfi) <dct (S 2 ,U 2 ) 
whenever 

(1) sh(,S*) < lox sh(,S*); 

(2) If sh(Si) = sh(S 2 ) then K (Ui) > lcx{A , } k(U 2 ); 

(3) If sh(Si) = sh{S 2 ) and k{Ui) = k{U 2 ) then 

(19) cs(Si) cs(Ui) > lex( ^ } cs(,S 2 ) cs(U 2 ), 

where cs(Si) cs(C/,) is the concatenation of cs(Si) and cs(/7,) for i = 1, 2. 
Example 6. Let 

/r 

and {S 2 ,U 2 ) = 



(Si,Ui) 



■5 


7 




3 


4 


8 


1 


2 


G 






1 




1 





1 


2 


1 


1 



■5 


7 




3 


4 


8 


1 


2 


G 



1 


1 




1 





1 


2 


2 


1 



Certainly sh(5*) = sh^). However 

(20) k(Ui) = (2,T,T,T,0,0, 1, 1) > lex( ^) k(U 2 ) = (2,2,1,1,0,1,1,1). 
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(Si,C/i) <pcr (S 2 ,U 2 ) 



So {S lt Ui) <dct {S 2 ,U 2 ). 

Similarly, we will say that 
(21) 
whenever 

(1) sh(Si) < lex{A) sh(S 2 ); 

(2) If sh(5i) = sh{S 2 ) then K (U!) < 1ox( ^) k(U 2 ); 

(3) If sh(Si) = sh(5 2 ) and k{Ui) = k{U 2 ) then 

(22) rs(Si) rs(tfi) > lex( ^) rs(S 2 ) rs(*7 2 ), 

where rs(S'j) rs(t7j) is the concatenation of rs(Si) and rs(£/j) for i = 1,2. 

Theorem 7 ([4, 7, 10]). Lef [S, U]dct be a bitableau on n boxes with U A' -filled 
such that either S is not standard or U is not column- strict. Then we can write 



(23) 



det 



where, for each i, it is true that di G Z, (Tj, V{) £ Q' n , 

{TuVi) > dct (S,U), 

«(Tj) = k(S) and n(Vi) = k(U). The above statements hold, mutatis mutandi, for 
bipermanents and the order > por . 



Example 8. 



[3 1 




2 




2 


l|' 




1 



= (e - (2,3))xiy 2 a;3 = a;i2/2a;3 - a;iy 3 a: 2 



dot 



j~3 




2 




1 


2|' 


1 


1 



dot 



T2 




I— 1 


3 



2 




1 


1 



dot 



IT 




TJ 


2 




l 


1 




l 



dot 



3. Cocharge Tableaux 

Given a hollow lattice diagram L 7 , to any standard tableau T = (f,dg(fi)), we 
define the cocharge diagram, C 7 (T) = (/i 7 oiro /, dg(/x)). Here, 7r is the usual 
"cocharge" map defined recursively by 



!0, ifi = l, 

7r(« — 1), if i > 1 occurs weakly southeast of i — 1 in T, 

n(i — 1) + 1, if i > 1 occurs weakly northwest of i — 1 in T. 

The map n is well-defined on standard diagrams. We then define hj as the unique 
order- and cover-preserving map from N to A that sends f~ 1 (m 2 +p 2 + 1) to (0, 0). 

Figure 3 gives an example cocharge diagram that corresponds to any 7 = 
(m,k,p) describing a lattice diagram with 9 boxes such that m 2 + p 2 + 1 is equal 
to 4 or 5. 

Lemma 9. Fixn andj. DefineCO ntl = {C 7 (T) : T £ SYT n }. There is a bisection 
between elements U £ CS n> A with u m2+P2+ i = and pairs (C, a) with C £ CO n ,-y 
and a £ A n such that on <a ch+i for 1 < i < n — 1 and a m2+P2+ i = (0, 0). 
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(0,2) 


(4,0) 






4 


8 






(0,5) 


(1,0) 


(4,0) 




3 


6 


9 




(0,7) 


(0,7) 


(0,0) 


(3,0) 




1 


2 


5 


7 



2 


4 






(0,0) 


(2,0) 






1 


3 


4 




(0,1) 


(1,0) 


(2,0) 










2 


3 




(0,2) 


(0,2) 


(0,0) 


(1,0) 



Figure 3. A diagram U, its standardization std(£7), 7r(std(Z7)) 
and C 7 (std(C/)). 



For an A- rilled diagram as in Figure 3, the sequence a of Lemma 9 is 

a = ((0, 5), (0, 5), (0, 4), (0, 2), (0, 0), (0, 0), (2, 0), (2, 0), (2, 0)). 

Proof. Let T = std([/) and C = C 7 (T). Map U to (C, a) with a; = u 4 - cf 
for each 1 < z < n. By the definition of /i 7 , cj n2+p2+1 = 0. Combined with our 
requirement for u m2+P2+ i, it follows that a m2 + P2 +i = 0. By the definitions of 
hj, it and standardization, the sequences cj , c£, . . . and iti, u 2 , . . . are both weakly 
increasing. That the a.{ are weakly increasing then follows from the additional fact 
that U is column-strict. □ 



4. Some Operations by Symmetric Polynomials 

We now review some important definitions and results with respect to sym- 
metric polynomials. A standard reference for this material is [14]. We intro- 
duce the following families of symmetric polynomials. We use the convention that 
tuples of elements of A' or A are written in boldface. In these definitions, let 
A = (Ai, . . . , Xj, . . . , A„) be a partition with j < n indexing the last nonzero part. 
(1) Define the monomial symmetric function as 



(25) 



m\{X n ) = 



E 



X-i Xn • ■ ■ X_ 



(26) 



v=(v 1 ,v- 1 ,...,v n ) 

where the sum is over all distinct permutations v of A. 
(2) For a sequence f3 — . . . ,/?„) £ (A') n , the MacMahon monomial sym- 
metric function 



mp{X n ,Y n ) 



= («l,«2, -A.) 



where the sum is over all distinct permutations 8 of (3. 
(3) For a positive integer r, the elementary symmetric function 



(27) 



l<i 1 <i2<---<i r <n 



Set e = 1 and e\ = e\ 1 ■ ■ ■ e\. . 
(4) For a positive integer r, the complete (or homogeneous) symmetric function 

(28) h r (X n ) = m x (X n ). 

|A|=r 

Set ho = 1 and h\ = h\ 1 ■ ■ ■ h\ j (we extend this definition in the obvi- 
ous way to the case where A is a j-tuple of nonnegative integers; i.e., not 
necessarily nonincreasing). 
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Lemma 10 ([3]; Theorem 5.4, Corollary 5.5). Suppose g : CS n .A' — ► CS n .A' such 
that for all W G CSa', W and g(W) have the same standardization. Fix T G SYT n , 
V G CSa> and write U = g(V). For each 1 < i < n, set Pi = — u,. Write 
(3 = (/?!,..., (3 n ). Suppose that (3 G A n and fa <a Pi+i for 1 < i < n — 1. Then 



(29) m/3(X n , r„)[T, C/] P cr = c T ,v[T, V] pcr + 

E c s . w [S 7 W] pcY - 



pen 



(S,W)>per(T,V) 

seSYT n ,wecs n , A 



SeSYT n 



where ct,v an d W is A' -filled with at least one entry not in A. 



Example 11. For f3 = (2,0,3), U 



1 




,r = 


3 




M 





1 


2 



(30) m/ 9(X3, y 3 ) [T, t/] per = 2[T, F] per + 2 



1 




2 


3_| 



and V = 
+ 2 



we have 



a 







3_| 



where a = (1,2). We see that the second bipermanent is, in fact, larger than 
(T,V) in the order > pcr as the content (2,1,3) is greater than that of V in the 
lexicographic order with respect to A. 

We also have the following Lemma (cf. [3], Theorem 5.2). 

Lemma 12. For (3 G (A') n and a lattice diagram L[a], 

(31) mp{dx,d Y ) A L [a] = E c<5 A L[ a -S] 

s 

for some constants cs G N. Here, the sum is over all distinct permutations S of f3. 
We use the convention that cs = if on — Si ^ A for some 1 < i < n. 



Proof. First note that mp{dx,dY) can be written as 



m (d X , dy) = £ n «■» = k £ n ot^dt^ 

S i=l v<ES n i=l 

for some constant K G Q dependent on the extent to which factors in f3 are re- 
peated. Then, 



mp(d x ,dy) A L[a] = K X\^ sgn(a)zr" (1) 

veS n i=l cr£S„ 



'(») 



"CT-It,)-/ 3 -^) 



(32) 



?=i 



e ^ yi sgn ( cr ) n 

0G5„ ctG5„ i=1 



for some constants cs- In the above, we consider the coefficient c v to be zero if the 
exponent of any of the Zi's is not in A. In addition, we have v — o~~ l (j) and let 8 
run over all distinct permutations of f3. □ 
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5. The Ideal g 7 (X n ,Y n ) AND THE RING C[-Xyj,l^i]g . 
Let Q 1 {X n , Y n ) be the ideal generated by the monomials in the collections 

(33) {a:i2/i, • • • ,x n y n } , 

(34) J Jl xA , and 

lieD J DC{l,2,.,n} { heE ) Ec{l,2,.,n} 

\D\= mi + Pl +l \E\=m 2 +p 2 + l 

Note that each of the monomials in equations (33) and (34) is in the ideal 
l 7 (X n , Y n ). Thus S 7 (X„, Y n ) C l 7 (X n , Y n ). 

For a sequence a = (a\, . . . , a n ) G {A) n , we define 

|X(a)| = ai i + a 2 i + h a„ i and 

(35) 

|y(a)| = ai j2 + Q!2,2 H ha„,2. 

For an arbitrary bipermancnt b = [T, V] pcl , we write |A(6)| as shorthand for 
|X(rs(V))|; similarly for | V (b) | . In addition we will write 

(36) {q) 3 = (1 - q)(l -q 2 )---(l- q j ) and (t), = (1 - i)(l - t 2 ) • • • (1 - 

for the rising factorial products. The generating function for the sum 

(37) 

subject to the constraints that a G .4", <_4 Qj+i for 1 < i < n — 1 and 
a m2+P2+1 = (0,0), is given by 

(38 ) Ef |*( a )| g | y (.,)| 1 TIT • 
Define 

(39) £ 7 = {[T, T/] pcr : T G SFT„, K G CO n ^} . 
Theorem 13. The Hilbert series of C[X n ,Y n ]g^ is given by 

(40) H(C[X n ,Y n ] g ^) = 1 1 J2 tlX(b)l 1™- 

\ l )m 1 +p 1 \Q)m 2 +p 2 be g 

Proof. Suppose (T, V) G 6^ and v m2+P2+ i ^ (0,0). Since V G CSj^ either each 
of the monomials in [T, V] per has at least m\+ p\ + l distinct factors, or 

each of the monomials has at least + P2 + 1 distinct y^s as factors. In cither 
case, [T, V] 

per ^ ^7 

(JT„, F„) as can be seen by examining the sets in (34). It follows 
that in looking for a basis of C[X n ,Y n ]g y , we can restrict our attention to those 
bipcrmanents for which v m2+P2+ i = (0,0). 

Additionally, if Vi £ A for some 1 < i < n, then each monomial of [T, V] pe r is a 
multiple of Xjyj for some j. (Note that j need not equal i as std(T) need not equal 
std(V).) Examination of (33) then shows that [T, V] pe r G G 1 (X n ,Y n ) in this case 
as well. 

On the other hand, it is easily seen that if v m2+P2+1 = (0, 0) and V G CS^, then 
[T, V^pcr ^ Gj(X n , Y n ). It follows from Lemma 4 that the set 

(41) {[T,V] pcr : (T,V) G 9„, Wpa+1 = (0,0)} 
is a basis for C[X„, Y n ]g^ . 
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The theorem then follows by combining the decomposition of Lemma 9 with the 
basis of (41) and the generating function of (38). □ 

Although the above proof constructs a basis of C[X n , Y n ]g y , it will be more useful 
in the next section to have the basis offered by Theorem 14. 

Theorem 14. The collection 

(42) S£B = { (ef (X n ) • • ■ (X n ) ef 1 (Y n ) ■ ■ ■ e fc£» (Y n )) b : b e B,} , 

where the ej and Pi are allowed to run over all nonnegative integers, is a basis for 

C[X n ,Y n ]g y . 

Proof. For this proof, linearly extend the notation |A(p)| to apply to elements 
p G SEB. 

By the proof of Theorem 13, it suffices to consider a bideterminant [T, V] per 
where (T, V) G 9„ and v m2+P2+l = (0,0). Set C = C T (std(V)). Note that 
Cm 2 +p 2 +i = (0)0) by construction. 

If Cj = Vi for all 1 < i < n, then V E CO nn ; hence, by definition, [T, V] p „ G B 1 . 
Assume not. We consider two possibilities. 

Suppose there exists such an index greater than m 2 + P2 + 1- Choose i to be 
the smallest such index. Let U denote the tableau for which Uj = Vj for 1 < j < i 
and Uj = vj — (1,0) for i < j < n. It follows from the proof of Lemma 9 that 
U G CSn iA - Note that that (T, f7) > pcr (T, V). 

Utilizing the identity e„_i+i = m^-i+i, it follows from Lemma 10 that 
(43) 

(A„) [T, J7] per — CT,y cs, iv W 7 "] per mod (<? 7 ). 

(5,V7)> P er(T,V) 

(Here we have used the fact that the monomials in e n -i + i(X n ) [T, U] per arising in 
the third term in (29) all have a factor Xjijj for some j. But, as we see from (33), 
these monomials are in Q 1 by construction.) The only remaining possibility is that 
there exists such an index i less than TO2 + P2 + 1 ■ Choose i to be the largest such 
i. Arguing as above, we obtain an equivalent expansion for ei(Y n ). 

Iteration of the above argument on the [T, U] per and [S, W] pcY implies that the 
collection ££B spans C[A n ,Y„]g; . (We use the facts that at most mi + pi of the 
Xi, and TO2 +P2 of the yi, can appear with positive degree in any of the monomials 
not in Q 1 .) 

For any b G B 7 , let pow(e, X n , b) denote the A„-degree of nl^ 1 !^ 1 e i i (^«)^ ) ar± d 
pow(/3,F n ,6) denote the 1^-degree of O^L 2 i +P2 e i % 0^n)b. It follows then that 



t \X( P )\ q \Y( P )\ = V t pow{e ' Xn - b) q pow{l3 ' Y "' b) 



E 

pe££B e£M m i+i'i /3eN™2+P2 beB-, 

(44) i i 

= JT— -TJ^ E i |X(6)l ? |r(6)l - 

(tjmi+pi (9)m 2 +P2 ^gjj 



The fact that the collection ££B spans C[A„,l^]g^ and yields the desired Hilbcrt 
series (see Theorem 13) implies that ££B must be a basis for C[X n , Y n ]g i . □ 



We have the following corollary: 
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Corollary 15. The collection 

(45) {e 1 (X n ),e 2 (X n ),..., (X n ),e 1 (Y n ),e 2 (Y n ),..., (^n)} 
is algebraically independent in the ring C[X n ,Y n ]g^. 

Proof. Any nontrivial algebraic dependence amongst the elements of (45) would 
yield a linear dependence amongst the elements of ££B, conflicting with its role in 
the basis for C[X n , Y n ]g y . □ 

6. The ideal H.y(X n ,Y n ) and the ring C[X n ,Y n \ n ^. 

Let 'H 1 {X n , Y n ) be the ideal in <C[X n , Y n ] generated by the collections of monomi- 
als in equations (33) and (34) as well as by the elementary symmetric polynomials 
in the collection 

(46) { (X n ),..., (Yn)}. 



12 



+ 



□ 



3 



□ 



Figure 4. Illustration of the fact that e2(dy)A L ^ i ^ 01 ^ equals l^A^^g^o.i)]- 

Consider the action of an elementary symmetric differential operator ej(dy n ), 
such as is illustrated in Figure 4 for j = 2. This operator moves each of j distinct 
cells down by one place. Any configuration in which two cells end up in the same 
position or in which a cell moves to a position not indexed by an element of A 
contributes zero. (The action of an ei(dx n ) is similar.) It follows that for any 
contributing monomial, the cells contiguous with (0, 0) are not moved. But any 
e Pl+ j(dx) for j > 1 or e P2+ i(dy) for I > 1 must move one of these fixed cells. So 
Tt 7 (X n ,Y n ) C T 7 (X n ,Y n ). Note that by construction, 7i 1 (X n ,Y n ) D Q 1 (X n ,Y n ). 
Theorem 14 and Corollary 15 imply the following two corollaries: 

Corollary 16. The set 



fPl + l P2+1 

(47) { ( l[e^(X n )- Y[e e /(Y n )\b:beB, 

= 1 3=1 J J eeN"i + 1 

2 + 1 



is a basis for C[X n , Y n ] ni . 

Corollary 17. The Hilbert series of C[X n , Y^u-, is given by 

(48) «(C[* B> y»]«J = 77T~ 7T" E i |X(&)l <Z |Y(h)l . 

Wpi+i Wp2+i b j£ 
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7. The ideals J 7 (X n ,Y n ) and IC 7 (X n ,Y n ) 

In the previous section, we considered symmetric functions whose corresponding 
differential operators moved collections of boxes, but for which each cell was only 
moved one place. Monomial symmetric functions yield operators that move cells 
farther. In this section we consider which ones will also annihilate A L [ a ]. In 
fact, due to fortuitous cancellations, we will focus on the differential operators 
corresponding to the complete symmetric functions. 




Figure 5. Illustration of the action of h 2 (dx 4 ) = m2(dx 4 ) + 
mu(d x <) on A L[a] for a = ((0, 1), (0, 0), (3, 0), (4, 0)). 

Figure 5 illustrates the action of h 2 (dx) — m 2 (c?x) + m n(^x) on a given A^r^i. 
Notice that the hollow lattice diagram 7 = ((1, 2), (2, 0), (1, 0)) is obtained in two 
different ways: once through the action of mn(dx) and once through m 2 (dx). 
However, for m 2 (dx) the cell that moves jumps over another cell. This leads to the 
introduction of a sign. Hence, the two A 7 that appear cancel. In fact, as Lemma 18 
shows, under the action of an hj on some A L [ a ], the only term that survives is that 
which moves the cell (mi + fci — 1, 0) (or (0, to 2 + k 2 — 1), as appropriate) j spaces. 

We now need to consider lattice diagrams that are subsets of hook shapes, but 
arc not hollow. In particular, we wish to consider hollow diagrams modified by 
sliding certain cells closer to the origin. The amount of sliding will be described by 
two sequences ao,...,(H and bo, ... , bj of nonincreasing, nonnegative integers. For 
brevity in what follows, write 

c = (m 2 - 1, . . . ,T,0, 1, . . ■ , mi - 1 ). 

Then, for L 7 = L[at] with 

a = (to2 + k 2 +P2 - 1, • • • ,m 2 + k 2 - l,c, mi + fci - 1 , . . . , mi + fci +pi - 1 ), 

we write j[ao, . . . , aj; bo, ■ ■ ■ , bj] for the lattice diagram corresponding to the collec- 
tion 

(m 2 + fc 2 - 1 + P2, ■ ■ ■ , m 2 + k 2 - 1 + i - at, . . . , m 2 + k 2 - 1 + - a , c, 
mi + fci - 1 + - bp , . . . , mi + fci - 1 + j - bj , . . . , mi + fci - 1 +pi ). 

Note that due to the nonincreasing restriction on the sequences, 

sgn(A 7 ) = sgn(A 7[a0i ... ;0 .. 6oi . ..,;,.]). 

An example is illustrated in Figure 6. In the figure, the left diagram is the hollow 
lattice diagram for 7 = ((2, 1), (6, 3), (2, 2)), while the right diagram illustrates 
7 [2,1;4,4,3]. 
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FIGURE 6. Sample square bracket notation for 7. 
Lemma 18. Let < j < k\ and < I < k 2 . Then 

(49) hj(d x ) A 7 (X, Y) = Cj A 7[0;j] and h e (d Y ) A 7 (X, Y) = c e A l[e . 0] . 

Proof. We only prove the hj(dx) version as the proof of the hi{dy) version is 
effectively identical. 

Recall that hj(X n ) = J2\x\=j m \{X n ). Let us consider A 7 (X, Y) for L 7 = L[a] 
where 

(50) a = (0,1,..., mi — 1 , mi + k\ — 1 , mi + fei + pi — 1, 

T, . . . , m 2 - 1, m 2 + fc 2 - 1, . . . , m 2 + k 2 +p 2 - 1) • 

(Note the unusual order in which we have listed the cells.) Let A = (Ai, . . . , A„) h j. 
View A as an element A of A n under the map Ai 1— > (Ai, 0). ft follows from Lemma 12 
that 

(51) m x (d x ) A 7 (X,Y) = Y,cu A I[M , 

where the sum is over all distinct permutations v of A. As previously, we use the 
convention c v = if a — v £ A n . 

Consider a particular permutation i> of A. If on — Vi = aj — Uj for some i =/= j 
then A i r a _ J/ i = as A i r a _ I/ i is a determinant. Recalling the ordering of a given 
in (50), note that if j^i 7^ for some 1 < i < mi, then we must have c„ = 0. 
Therefore, without loss of generality, we may assume that Vi t \ = for 1 < i < mi 
and that oti — Vi ^ aj — vj for i ^ j. 




Figure 7. Illustration of the involution described in the proof of Lemma 18. 

Let /j, be given by fj, mi +i = {j, 0) and ^ = (0, 0) for i ^ mi + 1. We now proceed 
to define an involution on the v whose only fixed point is /x. So assume v =^ fi. 
Define p < r to index the smallest two terms (with respect to <a) of 

(52) 
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The indices p and r index the two boxes of A^j not contiguous with the cell (0, 0) 
that have moved farthest to the left upon subtraction of v. Set 

(53) q = (a r ,i - v rA ) - (a pA - i/ pA ) . 
We now define 

(54) v ' = g{u)= Vj, i/ 2 , . . . , v Pt i - q , . . . , v r>1 + q , . . . , i 

The left-hand picture in Figure 7 illustrates ^L[a] f° r a = (0,4,5,6, 1). The right- 
hand picture illustrates A for v — (0, 3, 2, 2, 0) via the bottom triple of arrows 
(p = 2, r = 3, 1 = a 2 - V2 < ct3 - 1/3 = 3, and q = 2) and A L [ a _„/] for i/' = 
(0, 1,4, 2, 0) via the top triple of arrows. When viewed as sets, a — v equals a — v'\ 
they differ only in order. 
We have that 

(55) A L [ a _„] = — Ax,[ a _„/], 

since a — v and at — v' differ by a transposition. Now g(g{u)) — v. As desired, 
this function g yields a sign-reversing involution between all the terms k-L\a.-u\ m 
equation (51) except for the unique A£,r a _ M i. It is not difficult to see that the 
corresponding coefficients c v i in the expansion of toa(9x)A 7 (X, Y) in terms of the 
A L [ Q _ 1/ ] satisfy c v = c v i . Thus, all the terms in equation (51) cancel out except 
Az,[ a _ M ]. This gives the lemma. □ 



Recall that A 7 (X, Y) = if two of the entries in L 7 are identical. Thus, if j > k\ 
or £ > fc 2 , then A 7 [ 0; j] = or A 7 ^ ;0 ] = 0, respectively. It follows that 

Corollary 19. h kl+i (X n ) e l y (X n ,Y n ) fori>0 and h k2+h (Y n ) G l y (X n ,Y n ) for 
h>0. 

Corollary 19 provides information about certain elements that must be in the 
ideal I 1 (X n ,Y n ). As such, we will use it to define a sub-ideal JC y (X n ,Y n ) of 
lj(X n ,Y n ). Specifically, set IC-y(X n ,Y n ) to be the ideal in C[X„,Y„] generated 
by the generators of Hj(X n , Y n ) along with 

(56) (h kl (X n ), . . . , h kl+Pl+1 (X n ), . . . , hk 2 {Y n ), . . . , h k2+P2+1 (Y n ), . . .) . 

As it turns out, JCy(X n ,Y n ) is a finitely generated ideal in C[X n ,y n ]« T . To 
this end, define J 7 (X n ,Y n ) to be the sub- ideal of )Cj(X n ,Y n ) generated by the 
generators of H 7 (X n , Y n ) along with 

(57) {h kl (X n ), . . . , h kl+Pl (X n ), h k2 (Y n ), h k2+P2 (Y n )} . 
It follows from Corollary 19 that J 1 C /C 7 C X 7 . 

Lemma 20. JC y (X n ,Y n ) = J y (X n ,Y n ) (mod H 7 (X n , Y n )). 
Proof. A standard result (cf. [14, pg. 21]) is that 



(58) 



n 

^(-I) 1 ' e r (X n ) h n _ r (X n ) = 0. 

r=0 
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We prove that h kl + Pl + a {X n ) = (mod J-y{X n ,Y n )) for a > 1 by induction on a. 
For a > 1, we have 

pi+i 

(59) h k l+Pl+a 

(X n )= ]T(-l) r+1 e r (X n ) h k i+pi+a-r (Xn) 

r=l 

+ (- 1 ) r+1 e r (X„) 

+pi+a-r 

r= Pl +2 

Recall from (34) and (46) that e Pl+ j(X n ) G W 7 (X„, Y"„) for j > 2. So the second 
sum of (59) is in H.y(X n ,Y n ) C J^Xn, Y n ). On the other hand, by the definition 
of J^(X n ,Y n ), h kl+i G J 7 (X n ,Y n ) for < i < p\. So the first sum of (59) is in 
{X n , Y n ) as well. This proves the claim for a = 1. The claim for a > 1 thereby 
follows by the obvious induction hypothesis. Similar arguments can be made about 
hk 2 +p 2 +a(Y n ), for a > 1. □ 

Our next goal is to show that the collection that generates J 7 (X n , Y n ) in equation 
(57) is itself algebraically independent in C[X n ,Y n ]-H y . 

Theorem 21. The collection 

(60) {h kl (X n ), h kl+1 (X n ), h kl+Pl (X n ), h k2 (Y n ), h k2+1 (Y n ), h k2+P2 (Y n )} 
is algebraically independent in the ring C[X n7 Y n ]-H^. 

The reader is advised to follow Example 22 while reading the proof. 

Proof. The theorem is equivalent to the statement that there is no nontrivial poly- 
nomial P over C in pi + p2 + 2 variables such that 

(61) P(h kl {X n ), h kl+Pl (X n ),h k2 (Y n ), h k2+P2 (Y n )) e H 7 (X n , Y n ). 

Since the Xi and yi are true indctcrminates, such a relation would have to continue 
to hold upon the specialization y\ = ■ ■ ■ = y n = 0. Hence, it suffices to show that 
there is no nontrivial polynomial Q such that 

(62) Q(h kl (X n ), h kl+Pl (X n )) G H 7 (X n ,Y n ). 

So, to prove the theorem, we assume that such a Q does exist and obtain a contradic- 
tion. Specifically, we will show that if the hi in question are algebraically dependent 
in H.y(X n ,Y n ), then the ei of (45) are algebraically dependent in Q 7 (X n ,Y n ), in 
direct contradiction with Lemma 15. 

A relation such as (62) can be rewritten as 

(63) ^CA^eW^U 

A 

where each A is a partition with parts of length chosen from the collection {k\, fci + 
1, . . . , fci + pi}. We assume that c\ = for any A with h\ G H.y(X n , Y n ) and that 
there exists some c\ ^ 0. 

Since the monomial symmetric functions are a basis of the ring of symmetric 
functions, any such h\ can be expanded in terms of the e M . In fact, this can be 
done explicitly as follows (cf. [14, pg. 107]). 

Define a domino to be a set of horizontally consecutive squares in a Ferrers 
diagram. For A, fi h n, a domino tabloid of shape A and type /i is a tiling of dg(A) 
with dominoes of length (n, /j.2, We consider dominoes of the same length to be 
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indistinguishable. Let denotes the number of domino tabloids of shape A and 
type \i. Then we can write 

(64) h x (X n ) = £(-l)M-^)^ e^(X n ). 

n 

Recall that e M is in Q 1 (X n ,Y n ) (respectively, H.y(X n ,Y n )) whenever /j, has a part 
greater than or equal to mi + pi + 1 (respectively, p\ + 2). Combining (64) and 
(63), we find that 

(65) Y, ^c A d A , M ^e M (X n ) = (modW 7 (X„,F„)), 
mi<pi+i 

or, equivalently, that 



(66) 

A»l<Pl + l 



E (-l) H - W (E c A^e,(X„) 



a^e^Xn) = (mod(/ 7 (I„,y„)). 



pi+2</ii<pi+mi 

for some constants a M . If one of the a M ^ or one of the c a<^a,^ for 
some jU, then we have a contradiction (asserted by Corollary 15) of the algebraic 
independence in C[X n ,Y n ]g^ of the set {ei}i<i< Pl + mi . We will, in fact, show that 
at least one of the ^ A c x d x ^ is nonzero. 

For a given A, there is a maximum (with respect to lexicographic order) [i with 
dx^ ^ and e M g H 7 (X n , Y n ). It is given by 

(67) L(A) = ((pj + l)"^ 1 , (pi) *!, (pj - l)^!- 1 , . . . , (l)" 1 ) . 
Here, for 1 < f <Pi, a/ equals the number of entries in 

(68) A= (A 1 ,A 2 ,...,A, (A) ) 
congruent to / (mod pi + 1) and 

t{\) 

(69) a Pl+ i = Y 

r=l 

([x\ denotes the floor of x). In particular, modulo Hj(X n , Y n ), we can rewrite (64) 
as 

(70) h x (X n ) = ±d XMX) e L{x) (X n ) + Yl (-^^dx.^e^Xn) 

M<rlcxi(A) 

with d A ,L(A) 0. 

Furthermore, given /j,, there is a unique partition A (possibly with c A = 0) for 
which ll is the maximum element appearing in (64) with d x ^ ^ for some A. To 
see this, note that each a/ (when < / < p\) gives the number of Xj congruent 
to / (mod pi + 1). Since k\ < Xj < fci + p\ this uniquely identifies Xj. Each such 
Xj requires 



X r 
Pi + 1 



TT^prJ dominoes of length pi + 1 to finish out the row. Any remaining 



pi + 1 will be used to construct the remaining rows of A. 
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To finish the proof, pick from (63) the partition A occurring with 7^ for which 
L(X) is maximal. Certainly l(x) ^ 0. However, by this choice of A, d x = 
or c\ = for A ^ A. Hence, the coefficient of e £ ^ in (66) is nonzero as desired. □ 

Example 22. Fix 7 = ((4, 1), (7,0), (2,0)). In this example we consider the ex- 
pansion of h\ = ^(9,9,9,8, 7,7) in terms of the monomial symmetric functions modulo 
H-y(X n ,Y n ). In particular, we construct L(X) and show that A is recoverable from 
it. 

From pi = 2 it follows that L((9 3 ,8,7 2 )) = (3 15 ,2,1 2 ). The dominoes on each 
of the rows of length 7 and 8 can be placed in three different ways, so we find 
d(9 3 ,8,7 2 ).(3 ls .2,i 2 ) = 27. Then, following (70), /i(g3 j8 . 7 2)(X n ) is congruent to 

(71) -27e (3 i5, 2;1 2 ) (X„)+ (-1) M ~^(93, 8 ,72),^(X„) 

modulo H-y(X n , Y n ). On the other hand, given L(A) = (3 15 , 2, l 2 ), we can recover 
A as follows. We know that the parts of A must all be between k\ and fci 7 
and 9 in this case. The two l's in L(X) tell us that there must be two parts of A of 
length 1 modulo p\ + 1 = 3 (i.e., two rows of length 7). Similarly, we compute that 
there is a unique row of length 8. These three rows account for six of the fifteen 
length 3 parts of L(X). The remaining nine length 3 parts must together comprise 
the parts of length 9. Hence there are three of them and we recover A = (9 3 , 8, 7 2 ) 
as desired. This completes our example. 

Theorem 21 implies the following. 

Corollary 23. The Hilbert Series of C[X n ,Y n ]j y is given by 



H(C[X n ,Y n]jy ) = £ t^W 

Wti-iWpi+i Wfc 2 -i(r)p 2 +i 



pi + h 




P2 + k 2 




t 


V2 + l_ 



8. The ideals J 7 (X n , Y n ) = l 7 {X n , Y n ). 

We need to identify the generators of I 1 {X n ,Y n ) (recall equation (4)). Specif- 
ically, we want to prove that it is finitely generated by a collection of complete 
symmetric functions in the ring C[X n ,Y n ]-n . The goal is to show that the ideals 
J 1 and X 1 are equal in C[X n , Y n ]u„, ■ Since J 1 CI 7l we will do this by constructing 
a linearly independent set in C[X n ,y n ]x^ that gives the Hilbert series in equation 

(72) . Set 

(73) Qk,p = {(91, • • • 1 Qp) S N p : the qi are nonincreasing and qi < k} . 

Observe that |Q feiP | = ( p+k ). We can now define the collection of polynomials 
BB 1 that will turn out to be the required basis for C[X n ,Y n ]x y . (Recall that B 1 is 
defined in equation (39).) 



(74) BB^ = {h q {X n )h q >{Y n ) b:b€B 7 ,q£ Q kl - ltPl+1 ,q' e Q k2 -i, P2 +i} ■ 
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It follows from the remark above that the number of elements in BB^ is 



(75) n! 
Furthermore, note that 



Pi + fci\ fP2 + k 2 

Pi + 1 / V P2 + 1 



bees. 



Pi H 


-fci" 




P2 ^ 




.Pi 


f 1 


t 


P2 - 


f 1_ 



(76) V a |y(6)l = + P2 + «- 2 t |x(b)i 



„\YQ>)\ 



which equals the summation found in equation (72). 

In Theorem 25 we will consider the action of differential operators in the complete 
symmetric functions on the determinants A 7 . This theorem generalizes Lemma 18. 
The below example gives a sample computation in this spirit. 

Example 24. By Lemma 18, we have 

h-3,2(dx) Al[(o,i,2,3,9,io,ii)] = h 2 (dx) h 3 (dx) A L [(0,1,2,3,9,10,11)] 

= ((m 2 + mi,i)(9x)) (9 • 8 • 7)A L[( o,i,2,3,6,io,ii)] 

equal to 

gj "^uu,i,^,a,c,iu,»ii 1 gj "iyiiu, 1,^,3,0, a, iun 1 " gj 



11! 11! 10! 

Al [(0,1, 2,3,6, 10,9)] + -^j- A^ [(0,1, 2,3,6,9, 10)] + y-^j- A L [(0,1, 2,3,6,8, 11)] 

(78) 



10! 9! 

+ ~£T Al [(2,I,2,3,5,9,11)] + A L [(0,1,2,3,4, 10, 11)]- 

(We have omitted those A L [ a ] that have repeated entries and are thus identically 
equal to zero. We have also included exact coefficients even those these are not 
given by Lemma 18.) Note that the first and second terms cancel as they differ by 
the transposition of adjacent elements. This completes our example. 

Suppose the sequences /3 and 6 correspond to 7' = 7(0.0, . . . , df, bo, . . . bj] and 
7" = "f[a' , . . . , a-; b' , . . . bj], respectively, for some triple 7 and nonincreasing se- 
quences (at), (be), (a' e ) and (b' e ). We write (3 > CO nt S (or 7' > con t 7") whenever 

(1) (a , ...,di) >i ox {a' , . . .,a'i); or 

(2) if (oo, ...,a l ) = (a' , ...,<) then (6 , . . . , bj) >i ox (b' , b'j). 
Theorem 25. // 

, , q = (91,92, ••• ,q Pl +i) e Q kl -i, Pl +i and 

(79) 

9 = (°1> 92, • • • , 9p 2 + l) ^ Qfe2-l,P2 + l) 

i/ien we Ziaue 

(80) V(^) A 7 (X,y) = c 7 A 7 + ^ c 7 " Ay, 

7">cont7 

w/iere c 7 > and 

(81) 7 = 7 [91, 92, • • • , q Pl+ i:q[,q 2 , q' P2+1 ]- 

Proof. This follows from the argument in the proof of Lemma 18. Recall that 
since a complete symmetric function hj can be written as a nonnegative linear 
combination of monomial symmetric functions, the action of hj(dx) can be viewed 
as the movement of boxes to the left such that the distances traveled sum to j. 
In the proof of that lemma, we defined an involution that (among other things) 
canceled the contributions coming from any m M with /(^ (j). 
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In the situation of this theorem, we can proceed analogously. Here, though, we 
need to allow for the possibility that a box moved by an h qi also gets moved by an 
h q . for some j ^ i. However, any such resulting 7" will satisfy 7" > con t 7- □ 

The primary goal of this paper is to prove the following theorem. 

Theorem 26. The collection BB-y is linearly independent in C[X n ,Y n ]x y . Hence, 
by the equality of (72) and (76), BB 1 forms a basis for C[X n , Y n ]x i . 

By [1, Theorem 2.1], the subspace of By spanned by bipermanents [T, V] pcr of a 
given shape A and given V carries a copy of the irreducible S x . It is this fact that 
lets us conclude Theorem 1 from the Hilbert series (72) of Corollary 23. 

Note that it is enough to show that the collection 

(82) {b(dx,dy) A 7 (X,Y) : b G £>£> 7 } 

is linearly independent in C[X„,Y^] since 



(83) 



]T Cjbj = (mod J 7 (X„, Y n )) ]T Cjbj (dx,dv) A 7 (X, Y) = 

i 

bj(d x ,dy) A 1 (X,Y))=0. 



To do this, however, we need the following lemma. A proof can be found in [3] 
(see equations (6.5) and (6.6) in Theorem 6.2), however, there is a sign missing, so 
we include a proof here. The lemma lets us expand the action of a bipermanent 
on a determinant associated to a lattice diagram. To state the lemma succinctly, 
we first associate to the bipermanent in question a family of ^4-filled diagrams. So, 
consider a bitableau (T,C) £ 9 n and set S = std(C). Write i = Lt,s for the map 
that takes i to sf . For any permutation <p £ S n , we then define an ^'-filled diagram 
E" by placing — cf in the cell containing i in T. 



Lemma 27. Let ol= [cti, c*2, . . . , a n ] and (T, C) £0„. Th 



en 



(84) [T, C} pcl (d x , dy) A L[a] = sgn(0 ]T sgn(^) d^ [T*, (^)*] dct , 

0GS„ 

for the A' -filled diagrams E" defined above and integers d^ > 0. We make the 
convention that d^ = if any entry of E™ G A' — A or if [T*, (i?°)*]det = 0; 
otherwise d<f, > 0. 

Note that [T*, (i??)*]dot = when there is a repetition in some row of E?. 



Proof. Define qr,c — <ZT,c(3x,9y) to be the monomial d c z \d c z \ •••<9z". Then 
[T, C] pcr can be expanded as J2aeR T (7 ( < 1t,c)- Expanding A L ^ as well, we have 
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the following expression for the left-hand side of (84): 
[T,C} per (d x ,dY)A L[a] 



(85) 



As an illustration of the equality between the first two lines, consider 

(86) ((1,5,3R 4 >3 3 = 4C" 4 = (l,5,3)(aJX 8 )- 

In going from the second to the third lines, we set (j) — a ° r_1 use d the fact 
that the sign of any permutation is the sign of its inverse, and noted that as t runs 
over S n , so does cf). 

For each 4>, we would like to interpret the sum over a as a bideterminant 
[T*, (£'")*]det- Formally this makes sense as bideterminants are signed sums over 
the elements in the column stabilizer of some filled diagram. Here we have a signed 
sum over a row stabilizer; hence we consider transposes. If qT,c(9x,9y) were not 
in the equation, we would use a</>( t (i)) as our entry in E" corresponding to i in 
T. (The l accounts for the fact that we are not assuming S = T '.) Up to the 
multiplicative constants d^, the action of qT,c(dx,dy) is to subtract cf . This is 
consistent with the statement of the lemma. □ 



= sgn(T)(aq T ,c) ]J 



ctERt t£S„ 



J2 J2 s S n ( T ) a V T < C n z . 



ctERt tSS„ 



0)) 



Example 28. We illustrate Lemma 27 with the following simple computation. In 
this example, the identity is the only <f> for which the entries of E" are all in A. Also, 
i is given in cycle notation by (2, 4, 3) which yields sgn(i) = 1. In the second-to-last 
line, the subtraction of filled diagrams should be interpreted entrywise. 



4 




1 




3 









1 


2 




1 


2 



(d X ,d Y )A L U2.Q.l 



[(2,0,1,3)] 



(87) 



= (pyfil^x* + 01/2 0*! da*) det 



= 12 yi x 2 - 12y 2 X! = 12 



A/i 2/1 2/3 2/I\ 
1111 

Xi x 2 x 3 x 4 



x l x 2 x 3 



2 




3 




2 




1 


3 | 4 | ' 


2 


Q| 1| 


1 


Oil 



12 



2 




1 




1 


3 | 4 | ' 


1 


1 1 



dct 



(88) 



For U an .4-fiHed diagram, we define 

con x (?7) = [u rn2+P2+2 ,u m2+P2+3 , . . . ,u n ], 

COn Y (U) = [lti,U2, • • .Umj+pj], 



dct 
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where the square brackets indicate that we have arranged the elements of the sets 
in increasing order. Let (Ti, Ui), (T 2 , U 2 ) be bitablcaux. We define 

(89) (Ti.tfi) < bi tab (T 2 ,U 2 ) 

according to the following tiebreakers (recall that cs(U) denotes the column se- 
quence of U; cf. Example 5): 

(1) sh(T*) < lcx sh(T|); 

(2) con x (t/i) >iox con x (U 2 ); 

(3) con Y (i/i) <i ox con Y (U 2 ); 

(4) cs(f/i) <i cx( ^) cs(C/ 2 ); 

(5) cs(Ti) > lex( ^) cs(T 2 ). 

We are now ready to prove that BB 1 is a basis for C[X n ,Y n ]x y . As outlined in 
(83), it suffices to prove the following theorem. 

Theorem 29. Let T,U <E SYT n , q = (q 1 ,q 2 , . . . ,q pi+1 ) G Q fcl _i )Pl+ i and q' = 
(?li92v>9p 2 +i)eQfa-i,P2+i' SetC = C 7 (U). Then 

(90) h q (d x ) h q ,(d Y ) [T,C] pcr (d x ,d Y ) A 7 = d[T t ,P t ] det + dsMS^W'Ut, 

(S,W) 

where d ^ 0, P — Ef , and the sum is over all (S, W) E 9 n with (5, W) >bitab 
(T,P). 

Before presenting the proof, we illustrate (90) with an explicit computation. 

Example 30. Let 7 derive from the collection of boxes a = (4,3,0,3,4,5). Set 

2 I 2 

Then C = C\{U) = [fjl] and t = (2, 3) (4, 5). We 



T 



4 


6 




5 


6 


3 


■5 


and U = 


2 


4 


1 


2 




1 


3 



2 


2 





1 


H 






consider the expansion of 

fri,i(dx)/i 2 ,i(dr)[T, C]p er (dx,dr)A 7 

= [T,C} pc ,(dx,d Y )h 1 , 1 (dx)h 2 .i(d Y )A 1 



(9i) =[T,q pcr (a x ,ay) C/3 a lm + 53 C5 a l[s] 

\ <5>co„t/3 

= [T, C] pC r(d Xl d Y ) A m + cs t T ' CUridxM) A L[S] , 

l5> C ont/3 

where /3 = (3, 1,0,2,3,5). For 7 associated to the a. above, th 2 -\- p 2 + 1 = 3. In 
addition 



TOO.!!! 
Z <r(l) Z a(2) Z <r(3) Z a(4) Z a(5) Z a(6) ' 



(92) [r,c] pcr (x 6 ,y 6 ) = 53 

CT€S{1,2} X-S{ 3 ,5} XS{ 4>6 } 

It follows then that 

(93) [t, c] pcr (d Xe ,d Y6 ) = (d yi + d y2 )(d X3 + d X5 )(2 ■ d 2 X4 d 2 X6 ). 

So, by Lemma 27, [T, C] per (d Xe , dy^A^y^ can be expanded as 

(94) sgn( tT , t/ ) ^ sgn(0) d^T*, (^V- 
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It is easily checked for this particular example that the entries of will all be 
in A only if G "51,2,3 x 5*4,5,6 wfth (f)(1) ^ 3. There are 24 such permutations. 
Table 1 gives these <f> along with the coefficients c?0 and diagrams E%. We leave the 
expansion of the sum in (91) to the reader. This completes our example. 



■P\t 



4> d$ 


(5,6) 


720 


(2,3)(5,6) 


720 


(4,6) 


120 


(2,3)(4,6) 


120 


(4,5,6) 


360 


(2,3)(4,5,6) 


360 


(1,2,3)(4,5) 


120 


(1,2,3)(5,6) 


240 


(1,2,3)(4,5,6) 


120 


(1.2)(4,5) 





(1,2)(5,6) 





(1,2)(4,5,6) 






Cases 
1 & 2 



(2,3) 



720 
720 






1 


3 


2 


H 


H 




1 


i 


3 


2 





1 






1 


1 


2 


1 


3 




H 


1 


1 


2 





3 



Case 3 



(4, 5) 360 

(2,3)(4,5) 360 

(4,6,5) 180 

(2,3)(4,6,5) 180 

(1,2,3) 240 

(1,2,3)(4,6) 60 

(1,2,3)(4,6,5) 60 

(1,2) 

(1,2)(4,6) 

(1,2)(4,6,5) 






2 


3 


2 


H 






1 


2 


3 


2 












4 


1 


2 


1 






1 


4 


1 


2 









3 


1 


3 








1 



3 


4 











H 



3 


4 


1 















1 


3 





3 


1 






4 








3 


1 







4 


1 


o 


3 


lo 






4 





2 


1 


1 



1 


4 





2 





1 






2 





2 


1 


3 



1 


2 





2 





3 



3 


2 


3 












3 


1 


1 








3 



3 


2 


H 








3 






2 


3 





3 










1 


1 




3 


3 







2 





o 


3 


3 



Table 1 . Expansion of Example 30 



Proof. Let T, U € STT„. Using Theorem 25, we have that 
MftOMftO P,C] per (dx,dr) A 7 (X,F) 

= [T,c] pcr (d x ,dY)h q (d x )h q ,(d Y ) A 7 (x,y) 



(95) 



= [T,C] por (9x,9y) A L[/3] + c s A L[S] 

\ l5>cont/3 

- cp [T, C] pei (dx,dy) A L[/3] + cs P 1 ' C ]por(dx,d Y ) A L[S] , 

<5> CO nt/3 



24 EDWARD E. ALLEN, MIRANDA E. COX, AND GREGORY S. WARRINGTON 



with cp > 0. Now (abbreviating lt,u by b), Lemma 27 implies that 

(96) [T, C] pcr (d x ,d Y ) A m - sgn(0 £ sgn(0) d [T*, (Sj)*]def 

Therefore, 

(97) v(5y)[r,c]p Cr (a x ,9y) A 7 (x,y) 

= sgn(0 £ sgn(0) ( d [T*, )*]det + E c * <** ^ WW I ■ 

0G5„ \ <5>cont/3 / 

Our goal is to show that there is a minimum bitableau (with respect to <t>itab) 
occurring on the right-hand side of (97). First note that many of the bitableaux 
(T*, (E^Y) and (T*, (-E 1 *)*) are not standard. However, Theorem 7 tells us how the 
shapes and column sequences are affected by straightening. 

We split into three cases dependent on the indexing permutations (p. (A proof 
of an argument with similar statements and complete details can be in found in [3, 
Theorem 6.2].) 

Case 1: <f> = e. 

We get the first term on the right-hand side of (90) with d — cp d £ > 0. 

c T c T c T c T 

Case 2: 4> ^ e, but (^{z^ ■ ■ ■ z n n ) — z^ ■ ■ ■ z n n ■ 

For such <j>, k(E@) = k(P). However, it follows from the construction 
of C = C 7 (t7) from U that rs((£^)*) = cs(E%) >i ex(iA) cs(P) = rs(P*). 
Note that the E^ arising in this case arc standard and do not need to be 
straightened. 

T T T T 

Case 3: ^{z^ 1 ■ ■ ■ Zn" ) ^ z^ 1 ■ ■ ■ Zn n ■ 

We must have conx(E^) <i ox conx(-P) or cony^^) >i ox cony(P). 

It is not difficult to see that the E^ with 5 > CO nt that 

(98) (T,E*) >bitab (T,P). 

Thus, combinations of <f> and S ^ f3 substituted into equation (97) (and using 
Theorem 7) yield bideterminants [S, W] det with {S,W) >bitab (T,P). Thus, we 
have 

(99) h q {d x )h q ,{d Y ) [T,C] per (d x ,dY) A 7 (X,Y) = 

d[T t ,P t ] dct + ]T d s ,w[S*,W*]det, 

(S,lV)> bitab (T,P) 

with d ^ 0. This proves the theorem. □ 

Since we have that J 7 (X„, Y n ) C I 7 (X n , Y n ), the fact that the Hilbert series in 
equation (72) equals the summation in equation (76) implies that we must have 
Jj(X n ,Y n ) — lj(X n ,Y n ). Thus, equation (72) must give the Hilbert series for 
C[X n ,Y n ]x . Since the collection BB~ t is linearly independent in C[X n ,Y n ]x y and 
it gives the correct Hilbert series, we must have that BB^ is in fact a basis for 
C[X n , Y n ]x 1 - The proof of Theorem 26 is now complete. 
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9. Some notes, applications and conjectures 

Remark 31. Suppose T> is any basis for C[X n ,Y n ]x where 7 = ((mi,n — mi + 
1), (0,0), (0,0)) for some mi > 0. The basis V can be substituted in the place of 
By in the definition of £>£> 7 of equation (74) such that £>£> 7 still yields a basis for 
C[X n ,Y n ]j y . Examples of such bases V include descent monomials (see [3], [8] or 
[16]), Artin monomials (see [5]), Schubert monomials (see [13]) and Higher Spccht 
Polynomials (see [15]). 

Remark 32. The ideas of the previous sections are easily extendable to the com- 
plex reflection groups G(r,p, n). In this case, the lattice diagrams utilized are those 
of the form L[j3] where L[a] is a hollow lattice diagram and (3 = {(ra^i, ra^j) : 
a G a}. The resulting bases give representations of the complex reflection groups 
by ways of m-tableaux, standard m-tableaux and cocharge m-tableaux. See [3] to 
see how this translation is accomplished. 

Remark 33. Some of the results of this paper can be extended to diagonally sym- 
metric and anti-symmetric rings in the four sets of variables X n , Y n , Z n and W n . 
The diagonal action of S n on C[X n ,Y n , Z n , W n ] and the rings of symmetric polyno- 
mials and anti-symmetric polynomials C + [X n , Y n ,Z n , W n ] and C~[X n , Y n , Z n , W n ] 
are defined in the natural manner. For a G S n , set e + (cr) = 1, £~{<j) = sgn(cr). For 
each of + and — , define 

(100) i?± i72 = C ± [X n ,Y n ,Z n ,W n ]/{P G C ± [X n7 Y n7 Z n ,W n ] : 

P(dx,d Y ,d z ,d w ) A 7l (X„,y„) A, (2 (Z n ,W n ) = 0}. 

Furthermore, for an arbitrary standard tableau Q, set 

(101) [Ti,r 2 ]+ r = v{[Q,Tx]^{X n ,Y n ) [Q,T 2 ] pcr (Z n ,W n )) 

<tGS„ 

(102) [T u T 2 }- ei = v([Q,Ti] pe r(X n ,Y n ) [Q,T 2 ] pcr (d z ,d w )A, (2 (Z ni W n )) . 

Using the techniques found in [4], it is not difficult to show the following theorem: 
Theorem 34. For each of + and —, 

(103) BB± ui2{ = {h qi , qa ,..., qpi+1 (X,Y) h qW2! ... <i+i (Z,W) [T u T 2 }% r : 

sh(Ti) - sh(T 2 ),Ti G CO„, 7l ,T 2 G CO nn2 } , 

where (q lt q 2 , . . . , q Pl+1 ) G Q fel _i iPl+ i and (q[, q' 2 , . . . , q' P2+1 ) G Qfe 2 -i, Pl +i, is a 
basis for i? 7li72 - 

These are generalizations of rings that have been studied in [2, 16], for example. 
Furthermore, it should be noted that this theorem is not a generalization of the 
theorems found in [4]. Rather, we are just noting that the techniques found there 
easily generalize to the situation in this paper. 
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